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Drug-induced block of the cardiac hERG (human Ether-a-go-go-Related Gene) potassium channel delays 
cardiac repolarization and increases the risk of Torsade de Pointes (TdP), a potentially lethal arrhythmia. A 
positive hERG assay has been embraced by regulators as a non-clinical predictor of TdP despite a 
discordance of about 30%. To test whether assaying concomitant block of multiple ion channels (Multiple 
Ion Channel Effects or MICE) improves predictivity we measured the concentration-responses of hERG, 
Navl.5 and Cavl.2 currents for 32 torsadogenic and 23 non-torsadogenic drugs from multiple classes. We 
used automated gigaseal patch clamp instruments to provide higher throughput along with accuracy and 
reproducibility. Logistic regression models using the MICE assay showed a significant reduction in false 
positives (Type 1 errors) and false negatives (Type 2 errors) when compared to the hERG assay. The best 
MICE model only required a comparison of the blocking potencies between hERG and Cavl.2. 



The human ether-a-go-go-related gene (hERG, Kv 11.1) channel has played an especially important role in 
cardiac safety and the hERG patch clamp assay is a key regulatory requirement before a first in man trial 1 
(http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM074963. 
pdf). HERG produces 1^. the rapidly repolarizing potassium current in cardiomyocytes 2 . Roy et a\? and Suessbrich 
et al. 4 first showed that block of hERG was the molecular mechanism by which many non-antiarrhythmic drugs 
produced delayed repolarization, QT prolongation and torsade de pointes (TdP) a potentially lethal cardiac arrhyth- 
mia. Because TdP is rare for non-antiarrhythmic drugs, QT prolongation is used as a surrogate marker but by itself is 
a weak indicator of lethality; the adverse event of importance is the TdP arrhythmia 5 ' 6 . 

The hERG assay is interpreted by correlating in vitro concentration-responses with exposure to estimate the 
safety margin (SM) or ETPC Index (IiERGetpc) defined as hERG IC 50 /ETPC where ETPC is the effective free 
therapeutic plasma concentration. The poster drug for the hERG assay's utility was terfenadine (Seldane) because 
the assay gave the clearest non-clinical signal of the delayed repolarization linked to terfenadine's TdP outcome 3,4 . 
A reported odds ratio of 1.93 for the association between anti-hERG activity and the risk of serious ventricular 
arrhythmias and sudden death provided further support for the hERG assay 7 . 

To ensure safety, regulatory authorities have accorded a very high sensitivity to a positive hERG signal. The 
emphasis on sensitivity plus the limitations inferred from the odds ratio are consistent with the lack of 
specificity that has been reported 6 . As a result it is not known how many potentially useful drugs have been 
discarded. In fact, some potent blockers of hERG are already in use therapeutically and are not torsadogenic. 
Such an example is verapamil, a potent hERG channel blocker that is nevertheless used to treat cardiac 
arrhythmias, hypertension and angina pectoris 8 . One explanation for this discordance is that the simultaneous 
block of depolarizing calcium current offsets the effect of hERG block 912 . Can an understanding of multiple 
ion channel effects (MICE) 913 result in a better discrimination between safe and unsafe drugs? We tested this 
hypothesis by measuring the blocking potencies of 32 torsadogenic ( + TdP) and 23 non-torsadogenic (-TdP) 
drugs on hERG, and the depolarizing Cavl.2 and Navl.5 channel currents. We used logistic regression models 
to compare torsadogenic probabilities determined by block of hERG alone or block of hERG coupled with 
block of Cavl.2 and/or block of Navl.5. Consistent with our hypothesis we found that models using MICE 
variables significantly improved TdP predictivity. Of particular interest is that our best model only required in 
vitro measurements of the relative blocking potencies between Cavl.2 and hERG channel currents, independ- 
ent of effective therapeutic concentrations. 
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Figure 1 | IC50S of the 55 drugs included in the dataset for hERG, Cavl.2 and Navl.5. Symbols indicate mean values and lines the 95% confidence 
intervals of data. Values for the three channels are plotted as a function of drugs numbered in decreased order of potency. The drug order for each channel 
is indicated in Supplementary Table 3. 



Results 

Three major tasks in this project were to: 1) develop a reliable high 
throughput method to measure concentration-response curves since 
manual patch clamp would be impractical given the number of drugs 
and concentration-responses to be tested; 2) define the criteria that 
best assign risk to a large dataset that includes torsadogenic and non- 
torsadogenic drugs; and 3) find logistic regression models that best 
classify drugs for torsadogenic risk. The accomplishment of these 
tasks is addressed presently and in a Supplementary section. 

Task 1: Evaluation of automated patch clamp. The manual whole 
cell patch clamp is the "gold standard" method in determining the 
effects of drugs on ion channels, but it requires a high level of 
technical expertise and its throughput is low. To achieve the 
necessary throughput for a large dataset we used the QPatch and 
PatchXpress automated patch clamp (APC) instruments, which can 
achieve gigaseals. Figure 1 plots the IC 50 s of 55 drugs for hERG, 
Cavl.2 and Navl.5 block and the 95% confidence intervals of the 
data represented by the vertical lines. The IC 50 s for the three channels 
are well defined over several orders of magnitude with confidence 
intervals that are within the symbols. We noticed a reduced precision 
of Navl.5 currents at larger values due to concentrations that 
approached the solubility limit, requiring that IC 50 values be 
extrapolated assuming a Hill coefficient equal to 1. The hERG data 
for 29 drugs included in the dataset agree with published manual 
patch clamp data 6,12,14-15 . Where comparable protocols were used 
there was agreement for the Cavl.2 and Navl.5 results 12 . 

Tasks 2 and 3: Criteria used to predict TdP outcomes and 
subsequently model them. The torsadogenic outcome for each 
drug in the dataset was determined by consulting Redfern et al. 14 , 



and the Arizona CERT database (http://www.azcert.org/), each of 
which assigned torsadogenic risk to large numbers of drugs. Also 
consulted were FDA-generated package inserts (http://dailymed. 
nlm.nih.gov/dailymed/). Annotation is provided in Appendix 
Table 1. 

The measured IC 50 s recorded with the APC instruments were then 
correlated with the Torsade de Pointes outcomes. Figure 2a contrasts 
the IC 50 values for Navl.5, Cavl.2 and hERG of the +TdP com- 
pound terfenadine with those of the —TdP compound verapamil. 
To align these measurements with clinical exposure, the figure also 
shows the ETPC values. For terfenadine, the Navl.5 and Cavl.2 IC 50 
values are at least one order of magnitude larger than for hERG block 
and the ETPC. In the case of verapamil, both Cavl .2 and hERG block 
are comparable and close to the ETPC. We have shown in human 
stem cell-derived cardiomyocytes that the pure hERG blocker terfe- 
nadine prolongs the action potential duration (APD) at 90% repo- 
larization (APD90) whereas verapamil prolongs the APD 90 but 
shortens the APD 30 , an indication of calcium channel block 16 . 

Figure 2b compares the relationship among the ETPC Indexes for 
the three channels. The hERG ETPC value is the vertex of the blue and 
orange lines whose ends represent the Cav ETPC and Nav ETPC values 
respectively. Dashed lines indicate the level at which the hERG IC 50 is 
30-fold above the ETPC, a threshold for torsadogenic drugs 14 . 
Although the IiERGetpc values for both drugs are well below 30, 
terfenadine's Cav ETPC is ten times larger than its hERG E TPC value, 
whereas verapamil's Cav ETPC is lower than the hERG E x P c- This pro- 
filing provides a convenient way to illustrate the MICE hypothesis: 
strong "V" shapes suggest +TdP compounds and "A" shapes sug- 
gest — TdP compounds. 

Figure 2c provides separate profiles of the hERG, Cavl.2 and 
Navl.5 ETPC Indexes for the +TdP and — TdP drugs. In each group, 



Table 1 | Statistical comparison of the logistic regression models 



ROC analysis 



Model 


Lax 


D 


df 


P 




AUC Mean ± sem 


Change 


in AUC respect to Model 1 


Sensitivity/Specificity 


Model 1 


-29.15 










0.77 ± 0.07 






0.81/0.65 


Model 2 


-14.28 


29.74 


1 


4.9 x 


10" 8 


0.93 ± 0.04 


0.16 


± 0.08 (0.01/0.31) 


0.81/0.96 


Model 3 


-20.26 


17.79 


1 


2.5 x 


10" 5 


0.89 ± 0.05 


0.12 


± 0.06 (0.01/0.24) 


0.81/0.91 


Model 4 


-14.27 


29.78 


2 


3.5 x 


10~ 7 


0.91 ±0.05 


0.14 


± 0.07 (0/0.28) 


0.88/0.87 


Model 5 


-16.52 


25.26 


1 


5.0 x 


10^ 7 


0.93 ± 0.04 


0.16 


± 0.09 (-0.01/0.33) 


0.97/0.93 


Model 6 


-23.85 


10.61 


1 


1.1 X 


10" 3 


0.88 ± 0.05 


0.1 1 


± 0.08 (-0.04/0.26) 


0.88/0.78 



Lmax is the maximum log likelihood for the model. D statistics is 2 X (log likelihood of Model X- log likelihood of Model 1), P is the probability of rejecting Model 1 when true, df is the difference in free 
parameters between models. AUC is the area under the ROC curve of the cross-validated probabilities. The change of the AUC respect to the Model 1 is indicated with the mean ± s.e.m. and the95%Clofthe 
difference in parenthesis. Sensitivity and specificity were calculated at the cutoff determined by the J-index. 
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Figure 2 | ETPC indexes of torsadogenic and non-torsadogenic drugs. Terfenadine is concordant and verapamil is discordant with the hypothesis that 
potent hERG blockers are torsadogenic. (a) IC 50 values for hERG, Navl.5 and Cavl.2 and the maximum effective free plasma concentration, (b) Plot of 
the ETPC Indexes for hERG (indicated at the interception of blue and orange segments), Cavl.2 (point at the end of the blue segment) and Navl.5 (point 
at the end of the orange segment) . Dashed lines indicate the region defined by Redfern's ETPC index criteria of 30 for torsadogenic drugs 14 , (c) The ETPC 
Indexes for hERG, Cavl.2 and Navl.5 channels of the 32 +TdP and 23 — TdP drugs included in the dataset. The profile was explained in the legend of 
Fig. 1. Drugs were numbered for clarity in decreased order of IC 50 /ETPC values. +TdP drugs included: (1) ibutilide, (2) quinidine, (3) thioridazine , 
(4) flecainide, (5) halofantrine, (6) droperidol, (7) terodiline, (8) bepridil, (9) procainamide, (10) terfenadine , (11) nilotinib, (12) methadone, 
(13) sotalol, (14) moxifloxacin, (15) cisapride, (16) paliperidone, (17) haloperidol, (18) sparfloxacin, (19) astemizole, (20) dofetilide, (21) disopyramide, 

(22) sertindole, (23) clozapine, (24) chlorpromazine, (25) voriconazole, (26) pimozide, (27) sunitinib, (28) cilostazol, (29) solifenacin, (30) paroxetine, 
(31) risperidone, and (32) amiodarone. —TdP drugs included: (1) piperacillin, (2) verapamil, (3) metronidazole, (4) ceftriaxone, (5) linezolid, 

(6) telbivudine, (7) phenytoin, (8) ribavirin, (9) lamivudine, (10) diltiazem, (11) raltegravir, (12) saquinavir, (13) mibefradil, (14) duloxetine, 
(15) donepezil, (16) pentobarbital, (17) sitagliptin, (18) dasatinib, (19) diazepam, (20) mitoxantrone, (21) nifedipine, (22) nitrendipine, and 

(23) loratadine. Dashed lines have the same meaning as before. 



drugs were ranked from the lowest to highest hERG ETPC values. The 
plots reveal that +TdP and —TdP drugs can be qualitatively distin- 
guished from each other by their multiple ion channel ETPC Index 
profiles. In general safe drugs have either large hERG ETPC values or 
small hERG ETPC values but in the latter case, ETPC Indexes for at 
least one depolarizing current are within one order of magnitude of 
the hERG ETPC value. On the other hand, +TdP drugs show small 
hERG ETPC and large Nav EXPC and Cav EXPC values indicating very 
low or absent Navl.5 and Cavl.2 block compared to hERG block. 

The functional dependence between +TdP and the log trans- 
formed ETPC indices is shown in Figure 3. The fraction of +TdP 
drugs per decade of ETPC indexes estimates the probability of 
observing a torsadogenic drug P( + TdP) in that range. Each point 
indicates the averaged torsadogenic assignment ( + TdP = 1, —TdP 
= 0) and the bars indicate the standard error of the mean. Consistent 
with Fig. 2, high TdP risk is associated with larger — log(hERG E xpc) 
values (Fig. 3a). A negative functional relationship between TdP risk 
and — log(Cav ETPC ) was observed between — 3 and zero values of the 
independent variable (Fig. 3b). No clear association between block of 
peak Navl .5 currents and the fraction of + TdP drugs per decade was 
noticed (Fig. 3c). Figure 2 suggests that in a background of potent 
hERG block (hERG ETPC < 30, -log(hERG ETPC ) > - 1.477), Cavl.2 
block reduces TdP risk. Thus, we explored the functional relation- 
ship between P( + TdP) and the difference between Cavl.2 and hERG 
blocking potencies represented by the variable CavD defined in 
Methods (Fig. 3d). The plot shows the nonlinear relationship 



between P( + TdP) and CavD. Note that most of the change in TdP 
risk occurs within one order of magnitude with a center at zero where 
the hERG ETPC to Cav ETPC ratio is equal to one. 

MICE models are better TdP predictors than hERG alone. What 
combination of the above variables results in a logistic regression 
model that best predicts TdP risk? To address this question we 
calculated the maximum log likelihood (L max ) for each of the six 
models and then assessed the difference from Model 1 using the 
likelihood ratio test. Table 1 shows the statistical comparison 
between models. Note that inclusion of the — log(Nav EXPC ) and/or 
— log(Cav ETPC ) variables significantly increased the maximum log 
likelihood of the models and significantly decreased the probability 
of rejecting Model 1 when true. MICE models are significantly better 
than Model 1 that uses hERG block alone. 

The predictive power of the Models was assessed assigning torsa- 
dogenic probabilities to each drug in the dataset using a leave-one- 
out (LOO) cross-validation procedure described in Methods. The 
resultant TdP probabilities were used to construct ROC curves to 
find the optimal cut-off based on the J-index where sensitivity and 
specificity are maximal. Figure 4a shows the torsadogenic risk of the 
55 drugs included in the dataset as calculated under Models 1 
(— log(hERG E x P c) assay only) and 5 (CavD), the model with the 
smallest number of misclassified drugs. Figure 4b shows the ROC 
curves for both models and the J-indexes (cut-off value) indicated by 
arrows. 
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Figure 3 | Relationship between ETPC Indexes and the fraction of torsadogenic drugs. Panels (a-d) show the fraction of +TdP drugs (P( + TdP)) 
present in each decade of —log transformed ETPC indexes for hERG, Cavl.2 and Navl.5, and CavD respectively. Note that CavD is equivalent to 
log(hERG IC 50 /Cav IC 50 ). 
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Figure 4 | The MICE approach results in better predictive Models for TdP. (a) Calculated torsadogenic risk under Models 1 and 5 based in cross- 
validated probabilities. Boxes indicated the 25, 50 and 75 percentile; whiskers indicate the 10 and 90 percentiles, and filled diamond, mean values. Arrows 
indicate the probabilities of 0.47 and 0.46 at the J-index for Models 1 and 5 respectively, (b) ROC analysis of Model 1 and 5. The arrows indicate the cutoff 
point associated with the J-index. The dashed line indicates the performance of a Model that does not discriminate, (c) 2 X 2 Contingency tables for 
both models. Numbers in parenthesis indicate the area under the curve ± sem. Misclassified drugs are indicated in the tables at the bottom. 
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Note the poor separation of Model 1 probabilities compared to 
Model 5. Model 1 falsely identified verapamil as torsadogenic with a 
probability (P( + TdP) = 0.90) that was similar to terfenadine 
(P( + TdP) = 0.81). On the other hand, Model 5 correctly identified 
verapamil as non- torsadogenic (P( + TdP) = 0.31) and terfenadine as 
torsadogenic (P( + TdP) = 0.97). Under Model 5 only the +TdP 
drug voriconazole was identified as a false negative and the — TdP 
drugs telbivudine, loratadine, dasatinib and donepezil as false posi- 
tives. The calculated torsadogenic probabilities for all Models 
assessed in this study are shown in Supplementary Table 2. 

Comparison of the ROC curves reveal that 96.9% sensitivity in 
Models 1 and 5 is achieved with 56.5% and 17.4% false positive rates, 
respectively. This improvement in TdP prediction is accompanied by 
a 16 ± 9% increase of the AUC. Both logistic models have no 
intrinsic classification bias since random allocation of TdP traits in 
the dataset resulted in ROC curves near the identity line (not shown). 
Figure 4c shows the 2X2 contingency tables at the cutoff deter- 
mined by the J-index, the AUCs and the drugs misclassified by both 
models. Note that Model 1 misclassified 14 drugs whereas Model 5 
misclassified only five drugs. Thus, compared to Model 1, false posi- 
tives were halved and false negatives reduced six-fold. Table 1 shows 
the AUC and the change in the area with respect to Model 1 for all the 
models. ROC curves and contingency tables for all models are shown 
in Supplementary Figures 1 and 2. Based on the D statistics 
(Table 1), AUCs of the ROC curves (Fig. 4 and Supplementary 
Figs. 1 and 2), and the LR+ and LR- (Supplementary Fig. 2) 
Model 5 is the best of all the Models tested. Supplementary Fig. 3 
shows the fit of Models 1 and 5 to the experimental data. From this 
and the previous analysis the relative position of Cavl.2 block with 
respect to hERG block is the major determinant of Model 5 effec- 
tiveness. By virtue of being a ratio, the CavD variable is independent 
of ETPC and the relative potency of hERG to Cavl .2 block is a feature 
of the model. The efficiency of CavD as a torsadogenic classifier as 
shown by the step change in TdP assignments in Figure 3d, is sup- 
ported by the fact that a procedure not requiring parameter estima- 
tion to calculate torsadogenic probabilities using CavD results in a 
comparable classification (Supplementary Fig. 3). 

Discussion 

This study confirms our hypothesis that Models based on MICE 
more accurately predict torsadogenic potential than Models based 
on hERG effects alone. The difference between Models 1 and 5 is 
statistically significant. The value of the MICE approach is clearly 
shown in the plots of Figure 2, where +TdP and —TdP drugs show 
distinct profiles determined by the differences in blocking potencies 
between the depolarizing currents I Na and I Ca and the repolarizing 
current mediated by hERG. Unexpectedly, we found that a compar- 
ison of the relative blocking potencies between hERG and Cavl .2 was 
all that was necessary to improve predictivity of TdP for our data set 
of drugs; effective therapeutic plasma concentrations were not 
required. As a result the uncertainties surrounding measurement 
of clinical exposure due to protein binding of drug are removed; a 
comparison of potencies of block in vitro is all that is required to 
predict the TdP outcome. 

Model 1 had fourteen falsely categorized drugs: ceftriaxone, line- 
zolid, metronidazole, phenytoin, piperacillin, ribavirin, telbivudine 
and verapamil were false positives whereas amiodarone, cilostazol, 
paroxetine, risperidone, solifenacin and sunitinib were false nega- 
tives. Since the torsadogenic threshold for Model 1 is a hERG index 
value of approximately 30, it was not surprising to find this set of 
misclassified drugs. All false positive drugs have hERG Index values 
below or at the 30 threshold whereas all false negative drugs are weak 
hERG blockers with hERG Indexes above 90 (Fig. 2). 

Model 5 only had one false negative drug (voriconazole) and 
four false positives (dasatinib, donepezil, loratadine and telbivu- 
dine). Possible reasons for these misclassifications are as follows: 



voriconazole, telbivudine and loratadine displayed a large amount 
of variability in their Cavl.2 IC 50 values (Supplementary Table 1) 
and because Model 5 does not take into account the variability of the 
IC 50 values, their assigned torsadogenic risk probabilities are less 
certain. Also, our classification of voriconazole as a torsadogenic 
drug may be questionable because reported incidents of TdP have 
been observed in patients with multiple risk co-variates. For example, 
TdP occurred in a patient who had undergone induction chemother- 
apy which may have contributed to the development of TdP 17 . 

The reasons for false classification of dasatanib and donepezil are 
more difficult to explain. Both drugs have "V" shaped profiles indi- 
cating much more potent hERG block compared to Navl.5 and 
Cavl.2. This is typical of many torsadogenic drugs in our training 
set so the model may be overly sensitive to drugs that display these 
characteristics. However, it should be noted that there have been 
isolated cases of TdP reported for donepezil and even though no 
cases of TdP have been reported for dasatinib it has been reported 
that it prolongs the QT interval. Therefore, the TdP risk of these two 
drugs is greater than others in the —TdP group. 

The ETPC, protein binding and Cmax values were taken from 
multiple sources and we could not control for lab to lab variability 
in the data. In some cases we were limited by the solubility of the 
drugs in our buffer. In these cases IC 50 values were estimated using a 
binding equation with a Hill coefficient of 1 to extrapolate from the 
amount of block observed at achievable concentrations. All record- 
ings were performed at ambient temperatures. Kirsch et al 15 , demon- 
strated that erythromycin and dZ-sotalol inhibit hERG current more 
potently at physiological temperature. Interestingly in this study, dl- 
sotalol is more potent than in Kirsch et al. 15 (111.4 uM vs. 278 uM, 
respectively). Effects on ion channels, other than hERG, Navl.5 and 
Cavl.2, were not considered, but block of repolarizing currents other 
than hERG may increase TdP risk 18 . 

Pentamidine is a drug that does not directly inhibit hERG current 
but does reduce the surface expression of hERG and causes TdP 19 As 
a result, our models may misidentify drugs that exclusively inhibit 
the surface expression of hERG. Trafficking data is only available for 
seven of the drugs in our training set. Amiodarone, thioridazine, 
chlorpromazine, terfenadine and mibefradil decrease surface 
expression of hERG but for these drugs, direct block of hERG is 
the predominant factor in terms of TdP risk because all hERG 
IC 50 s are < 2 uM while significant reduction of hERG surface 
expression occurred at 10 uM 19 . Cisapride and quinidine do not 
inhibit the surface expression of hERG 19 . The rest of the drugs that 
were used to construct our models have not been evaluated for traf- 
ficking effects so it is unknown if any of the false negatives affect ion 
channel trafficking. 

A predictive model is normally fit to a training set of data and a test 
set is used to assess the strength and utility of the predictive model. 
The restricted size of the dataset made it impossible to have separate 
"training" and "test" sets. Thus, we performed a leave-one-out cross 
validation to calculate the torsadogenic probability of each drug. 
ROC curves calculated using scrambled assigned torsadogenic clas- 
sifications had AUC values that were approximately 0.5 for all mod- 
els demonstrating a lack of bias for particular models (not shown). 

We have shown that a logistic regression Model based solely on 
hERG is not as good as regression Models based on MICE. In addi- 
tion, the MICE regression Models are better than the conventional 
approach of identifying torsadogenic drugs as those that have hERG 
IC 50 values less than 30-fold from the ETPC. Using the 30-fold cutoff 
value resulted in 16 misidentified drugs which is, as expected, similar 
to the results seen with Model 1 which resulted in 14 misidentified 
drugs. However, we have shown that logistic regression models that 
include Cavl.2 or Navl.5 current block as a mitigating effect are 
more predictive of TdP risk. Other models that have been used to 
determine torsadogenic risk include both ex vivo and in vivo models 
such as the female rabbit ventricular wedge preparation 20 , the 
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Langendorff-perfused female rabbit heart (Screenit Model) 21 , 
Purkinje fiber action potentials 22 and AV ablated dogs 23 . While use- 
ful, all of these models share similar disadvantages in comparison to 
our ion channel approach; they are low throughput, more expensive 
and therefore can only be practically used late in the drug develop- 
ment process. 

Approximately, 90% of all drugs withdrawn from the market are 
linked to toxicity and safety 24 . By far the most dramatic risk for all 
drugs is sudden cardiac death. TdP the outcome of present interest is 
associated with a death rate of about 20%. Thorough QT studies in 
man are meant to detect TdP risk in humans but these studies are 
performed after hundreds of millions of dollars have already been 
spent on development. For this reason drug developers give the 
hERG assay extraordinary sensitivity which as the present study 
shows is unwarranted. The MICE assay is not only better than the 
hERG assay but, the fact that it uses automated patch clamp instru- 
ments, provides higher throughput and faster turn-around times 
than the manually performed patch clamp method. This study 
demonstrates that TdP risk can be accurately assessed using MICE 
early in the development process. 

Methods 

Drugs. Drugs were from LGM pharma (TN), Selleck Chemicals LLC (TX), Sigma- 
Aldrich (MO), Synfme research (Canada) and R&D Systems (MN). Providers are 
indicated for each drug in Supplementary Table 1. Test article stock solutions were 
prepared in DMSO and stored frozen. Test article concentrations were prepared fresh 
daily by diluting stock solutions into an extracellular buffer (HEPES-buffered 
physiological saline solution, HBPS). 

Cells. hERG (KCNH2 gene, Kvll.l channel) channels were stably expressed in 
HEK293 cells. Navl.5 (SCN5A gene, hNavl.5 channel) and Cavl.2 (CACNA1C/ 
CACNB2/CACNA2D1 genes, hCa v 1.2/p 2 /a 2 5 channel) channels were stably 
expressed in CHO cells. All cell lines were from ChanTest Corporation. 

Electrophysiology. The IC 50 values for block of hERG, Cavl.2 and Navl.5 channels 
were measured using QPatch and PatchXpress automatic patch clamp systems. All 
experiments were performed at ambient temperature. 

Solutions. Extracellular solution. The extracellular solution for the three channels in 
both QPatch-HT and PatchXpress instruments was the HBPS solution containing (in 
mM): 137 NaCl, 4 KC1, 1.8 CaCl 2 , 1 MgCl 2 , 1; 10 HEPES, 10 Glucose, pH adjusted to 
7.4 with NaOH (supplemented with 0.3% DMSO.) 

Intracellular solutions. hERG currents: The intracellular solution used in QPatch- 
HT and PatchXpress instruments contained: 130 K-aspartate, 5 MgCl 2 , 5 EGTA, 4 
Na 2 ATP, 10 HEPES, pH adjusted to 7.2 with KOH. 

Cavl.2 currents: The intracellular solution for QPatch-HT experiments contained: 
130 Cs-aspartate, 1 CaCl 2 , 5 MgCl 2 , 2 EDTA, 10 EGTA, 4 Na 2 ATP, 10 HEPES, pH 
adjusted to 7.2 with CsOH. The intracellular solution for PatchXpress experiments 
contained: 130 Cs-aspartate, 5 MgCl2, 10 EGTA, 4 Na 2 ATP, 0.1 GTP, 10 HEPES, pH 
adjusted to 7.2 with CsOH. 

Navl.5 currents: The intracellular solution for QPatch-HT experiments contained: 
120 CsF, 2 MgCl 2 , 10 EGTA, 30 CsCl, 5 NaF, 5 HEPES, pH adjusted to 7.2 with CsOH. 
The intracellular solution for PatchXpress experiments contained: 130 Cs-aspartate, 5 
MgCl 2> 5 EGTA, 4 Na 2 ATP, 0.1 GTP, 10 HEPES, pH adjusted to 7.2 with CsOH. 

Voltage protocols. The following voltage protocols were used to evaluate the effects 
of the drugs on ion channel currents. 

hERG currents. hERG block was measured using a stimulus voltage pattern 
consisting of a 500 ms pulse to —40 mV to assess the leak current, a 2 s activating 
pulse to +40 mV,anda2 stest pulse to —40 mV (tail current). The pulse pattern was 
repeated continuously at 10 sec intervals from a holding potential of —80 mV. 

Cavl.2 currents. Cavl.2 channel block was measured using a stimulus voltage 
pattern consisting of a 150 ms test pulse to 0 mV elicited at 5 sec intervals from a 
—40 mV holding potential. CdCl 2 (200 uM) was added at the end of each experiment 
to block hCavl.2 current and calculate leak. Only one drug, pentobarbital, was 
evaluated in PatchXpress. In this case the holding and test potentials were —80 mV 
and + 10 mV respectively. 

Navl.5 currents. Navl.5 channel block was measured using a depolarizing test 
pulse to —10 mV from a 200 ms hyperpolarizing conditioning pre-pulse to 
— 120 mV. The pulse pattern was repeated at 10 sec intervals from a holding potential 
of —80 mV. Leak current was calculated after complete inactivation of the sodium 
current at the test potential. 



Analysis of drug effects. For ion channel testing, data acquisition and analyses were 
performed using the QPatch Assay or DataXpress software. When possible, dose 
response curves were constructed using concentrations (in half log increments) that 
blocked approximately 10% to 90% of the ion channel current. However, the maximal 
concentrations tested were limited by solubility. 

Concentration-response data was fitted to an equation of the following form: 

% Block - {1 - 1/[1 + [Test]/IC50] N } x 100 

Where [Test] was the concentration of test article, IC 50 was the concentration of the 
test article producing half-maximal inhibition, N was the Hill coefficient, and % Block 
was the percentage of ion channel current inhibited at each concentration of the test 
article. Nonlinear least squares fits was solved with the Solver add-in for Excel® 
(Microsoft, Redmond, WA). Where appropriate, data are expressed as means ± sem. 

Modeling. Classification of drugs as + TdP or — TdP. We classified the torsadogenic 
outcome for each drug in the dataset using the five categories enunciated in Redfern 
et al. 14 , the Arizona CERT database (http://www.azcert.org/) case reports in the 
literature and FDA-generated package inserts (http://dailymed.nlm.nih.gov/ 
dailymed/). The classification is annotated in Appendix Table 1. 

Effective therapeutic plasma concentrations. The unbound effective therapeutic 
plasma concentration (ETPC) for each drug was collected from the literature 14 or 
calculated from Cmax and percent protein binding data found in the literature. For 
references see Supplementary Table 1. 

Statistical methods. The statistical software used was implemented by the R 
Development Core Team (http://www.R-project.org/). 

Description of the data and models. The data set is comprised of n — 55 compounds 
for which both torsadogenic classification and reliable measurements of ion-channel 
block were available. We defined the ETPC index as the ratio of the IC 50 for 
channel block to the effective free therapeutic plasma concentration (ETPC). For 
analysis we use the —log transformed ETPC indexes 

-log(hERG E TPc) = -/o£(hERG/C 5 o/ETPC)= - [log(hERGIC 5 o) - log(ETPC)] 

=H-E 

- log(Cav ET pc) = -Zog(Cavl.2JC 5 o/ETPC)= - [log(Cavl .2IC 5 o) - log(ETPC)] 
= C-E 



■ log(Nav ET p C ) 



Where 



= -%(Navl.57C 50 /ETPC)- 
=N-E 



[log{Navl .5IC 50 ) - log{ETPC)} 



H=-log(hERGIC 50 ) 
C= -log{Cavl.2IC 5Q ) 
N= -log(Navl.5IC 50 ) 
E= -log(ETPC) 

are the basic variables. 

We also define the variables CavD asC — H and NavD as N — H. D stands for the 
logarithmic distance of the block potencies between the indicated channel and hERG. 

The six logistic regression models for TdP under consideration are 

Logit( TdP) =0 O + fS hERG {H-E) [Modell] 

= ft, + /W( H " £ ) + PcAC- E) [Model2] 

= ft> + /W( H " £ ) + ftto ( N - E) [ModeB] 

= ft) + hmoiH-E) + ft-; av (C-£) + P Nm (N-E) [Model4] 

= ft> + /W(C--E) - (H—E)] =/l 0 + ll CavD (C-H) [Models] 

= ft) + /W(N-£) - (H—E)] = ft + P N „ D (N-H) [Model6] 

Note that Models 5 and 6 are independent of E. 

For the assumptions of logistic regression to hold, the distributions of the argu- 
ments in the two subpop illations ( TdP — 0 and TdP — 1 ) must belong to the same one 
parameter exponential family. For the above six models, this requirement must hold 
for all linear combinations of (H + E), (C + E) and (N + E). The simplest way for this 
to happen is for these three variables to have a multivariate normal distribution in 
each of the two subpopulations. We investigate this possibility by first checking the 
univariate distributions in the two subpopulations and then doing a qqplot check of 
multivariate normality based on Mahalanobis distances 25 . 

Two sample comparisons. Table 2 shows the ETPC adjusted variables for the TdP = 0 
and TdP — 1 classes. The only possibly non-normal distribution is that of C — E in the 
TdP — 0 class, which appears to be a bit left-skewed (not shown). Nevertheless, the 
distribution does not fail the test for univariate normality. 
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Table 2 | 


Basic Statistics for the TdP CI 


asses 








TdP: 0 (n = 23) 


TdP 


1 (n = 


32) 




H-E C-E N-E 


H-E 


C-E 


N-E 


mean 
SD 

SW* 


-5.02 -3.51 -5.83 
2.39 2.92 2.63 
0.67 0.07 0.84 


-2.51 
1.92 
0.48 


-5.35 
2.46 
0.54 


-6.17 
2.68 
0.9 


*p-value of th 


e Shapiro-Wilk's test for normality. 









Check for multivariate normality. If a distribution is multivariate normal, then the 
squared Mahalanobis distances D 2 from the points to its center follow a chi-square 
distribution with degrees of freedom d equal to the dimension of the data. Here d — 3. 
The conformity of the data with this theoretical distribution implies that the method 
of Logistic Regression is appropriate {not shown). 

Evaluation of the LR models. The maximum log likelihood (L max ) of each model was 
calculated using ad hoc programs written in Java based on the Newton-Raphson 
method.. Differences between models were assessed using the likelihood ratio test (D 
test). Two times the difference of the log likelihood for each nested model was used to 
calculate % 2 and the probability of rejecting the model with the lower number of 
parameters when true 26 . 

Receiver operating characteristic (ROC) analysis. The predictive power of the models 
was assessed assigning torsadogenic probabilities to each drug in the dataset using a 
leave-one-out (LOO) cross-validation procedure. To this end 55 datasets (training 
sets) were built by removing one drug at a time from the total set. For each model, its 
logistic equation was fitted to each training set, and the fitted coefficients used to 
assign a torsadogenic probability P(+ TdP) to the drug that was 'left-out'. This process 
was repeated until all compounds had a predicted cross -validated probability 
assigned. Receiver Operating Characteristic (ROC) curves were used to quantify the 
results 27 . An optimal cut-off, set by the Youden's index (J) 28 (defined as the threshold 
point where sensitivity-(l-specificity) is maximal) was chosen to build 2X2 con- 
tingency tables and calculate likelihood ratios (LR+ — sensitivity/(l-specificity) and 
LR— = (l-sensitivity)/specificity). ROC curves were compared among the different 
models measuring the area under the curve (AUC) and the 95% confidence intervals 
for the differences between AUCs 29 ' 30 . ROC curves and the AUC were calculated using 
JMP software (Cary, NC). 
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